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The Complexity of the Thouless- Anderson-Palmer (TAP) solutions of the Ising p-spin is investi- 
gated in the temperature regime where the equilibrium phase is one step Replica Symmetry Breaking. 
Two solutions of the resulting saddle point equations are found. One is supersymmetric (SUSY) and 
includes the equilibrium value of the free energy while the other is non-SUSY. The two solutions 
cross exactly at a value of the free energy where the replicon eigenvalue is zero; at low free energy 
G ' the complexity is described by the SUSY solution while at high free energy it is described by the 

3 , non-SUSY solution. In particular the non-SUSY solution describes the total number of solutions, 

like in the Sherrington-Kirkpatrick (SK) model. The relevant TAP solutions corresponding to the 
lO ' non-SUSY solution share the same feature of the corresponding solutions in the SK model, in par- 

O^ , ticular their Hessian has a vanishing isolated eigenvalue. The TAP solutions corresponding to the 

SUSY solution, instead, are well separated minima. 
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I. INTRODUCTION 



Mean-field magnetic models of spin glasses with built-in quenched disorder display, in general, different kinds of 

frozen phases selectable by choosing the type of interaction among their microscopic elements. The pure phase can 

C^ , be either "glass", described by means of a step function order parameter, the overlap q — qo9{m — x) + qi9{x — m), 

C ' or "spin-glass", in which case the order parameter is a monotonous increasing function q{x). The overlap q and its 

I ' conjugated x come out naturally in the replica approach following the Replica Symmetry Breaking (RSB) Ansatzi 

' O The parameter x is, then, the replica group index, and q represents the similarity between replica groups labeled by 

C ■ X. The first phase mentioned is a one step RSB (IRSB) phase, for which a two levels hierarchy is hypothesized and 

replicas can simply lay in the same group {q = qi) or in different groups {q = qo < Qi)- The second kind of phase, 

instead, is stable only when the replica symmetry is broken an infinite number of times, and one refers to it as Full 

RSB (FRSB) solution. In a properly said spin-glass, thus, any kind of level of similarity can take place, between the 

extremal values of q{x), being go the minimal and gi the maximum. The parameter qi is called the self-overlap, i.e. 

the overlap among replicas in the same group, or Edwards- Anderson^ parameter. 

In the model that we are going to study in the present paper, the Ising p-spin model, '^■'^■^■^■^ both phases occur. In 
\^ ' a cooling down from high temperature (paramagnetic phase) , below some point the dynamic quantities become stuck 
\^ out of equilibrium, never reaching their static values. In this temperature regime the time translational invariance of 
^^ two-time quantities is lost and aging takes place. Cooling further, the high energy states responsible for the slowing 
\l , down of the dynamics become more and more important down to the point where their free energy becomes lower 
^^ ■ than the one of the paramagnetic phase. At such temperature a thermodynamic transition occurs to a IRSB phase. 
Eventually, at lower temperature, the system undergoes a second phase transition to a FRSB spin-glass phase. 

Both frozen phases are characterized by a very high number of stable and metastable states, although of different 
nature. Such a large range of choice is in its turn the consequence of the disorder and the subsequent frustration char- 
1-^ i acterizing spin-glasses and causing the onset of many different configurations of spins minimizing the thermodynamic 
^ ■ potential, organized in the configurational space in rather complicated ways. In order to describe the structure of the 
O landscape of the free energy functional a fundamental tool is the so called complexity, else said, in the framework of 
O structural glasses, configurational entropy. This quantity is the quenched average of the logarithm of the number of 
^ , metastable states. In the present work we have performed a thoroughly investigation of the complexity of the p-spin 
: '"! • model in the IRSB phase. 

r> ' A significant role in the investigation of the properties of the stationary points of the mean-field free energy landscape 

S . is played by a Becchi-Rouet-Stora-Tyutin fermionic symmetry)^ that arises following a particular formal approach, 

■ " " ' recalled in Sec. The initial symmetry of the action involved in the reckoning of the complexity functional is not 

always conserved when the complexity saddle point is evaluated. In the present work we deepen and continue the 

contents of Ref. [l^ related to the Ising p-spin. 

In Sec. ^we present the Hamiltonian of the model, we recall its basic properties and we define the complexity as 
the Legendre transform of the replica free energy potential. In sec. Illll we follow the alternative approach of Thouless, 
Anderson and Palmer (TAP) to mean-field disordered models and we complete the analysis of the TAP complexity 
already performed by Rieger.^ In Sec. IIVI the two qualitatively different complexities are computed and displayed. 
There we present a study of the stability of the states counted by the complexity. In Sec. 0we give account for the 



qualitative differences between BRST and non-BRST complexities in terms of the spectrum of the eigenvalues of the 
Hessian of the TAP free energy. In Sec. I VII we present our conclusions. 



II. MODEL 



The Haniiltonian of the model is 



JV 

H= Yl Jii-tp'^ii---<^ip~hYa, (1) 

ii<...<ip 1=1 

where the dynamical variables ai are Ising spins and the couplings Ji^...^ are quenched random variables distributed 
as 

P(J,,...,g = _-cxp -^^^^- (2) 



V ■■^- \ ^' / 

This is a generalization of the Sherrington-Kirkpatrick (SK) model j2^ recovered for p ^ 2, to interactions involving 
more than two spins. In the following we set h ~ 0, since the connection between the different approaches to the 
computation of the complexity that we will consider here relies on the absence of external magnetic fields. 

In the high temperature regime this model is in a paramagnetic phase. As the temperature is decreased, a dynamic 
transition occurs at Td, with onset of an aging regime. Below that temperature two thermodynamic phase transitions 
take place. We denote by Tg the critical temperature for the static transition between the paramagnetic and the 
intermediate (glassy) frozen phase and by Tq (Gardner temperature) the one at which the transition to the low tem- 
perature frozen phase (spin-glass) occurs. The statistical mechanical properties can be computed applying the replica 
trick. The phase displayed in the temperature range [Tg,Ts] turns out to be a one step Replica Symmetry Breaking 
(IRSB) one (even though the replica symmetric solution (RS) stays stable), whereas at the Gardner temperature the 
system reaches a qualitatively different phase stable only when an infinite number of RSB is performed. Since, for 
p > 2, the paramagnetic, RS phase is stable in the replica space at any temperature, the transition temperature Tg is 
obtained as the one at which the IRSB free energy becomes lower than the RS one, that, by the way, in this model 
coincides with the onset of the IRSB static solution. 

In the present paper we will concentrate on the behavior of the states structure in the IRSB phase. 

A. Intermediate glassy phase in the replica formalism: complexity as Legendre transform of free energy 

For clearness (and to introduce notation) we very shortly summarize the basic results already obtained in the 
seminal paper of Gardner— and recently used in Ref. |7|. Performing the quenched average over the disordered 
interaction, the free energy is obtained with the replica tricl*ii in terms of the overlap order parameter q{x) — 
qo9{m — x)9{x) + qi9{x — m)9{l — x). In the case of zero external field (inducing qq = 0) it reads: 



/3$ = -^[H-(p-l)(l-m) qf-pqf] log / Vz hcoshzVX 

4 m J^oo ^ 



(3) 



with X = j.1 ql , fJ- = /3 p/2 and Vz = (iz/v27rexp(— z /2). The self-overlap gi is computed by means of the 
self-consistency equation 

(tanh^ zVx) (4) 
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/ m 



^ /_°lPz(...)(coshz^/A) 
f^^ Vz ( cosh zVX j 



At T — > Ts, the Edwards- Anderson parameter qi jumps discontinuously from to a finite value for p > 2, unlike the 
SK case for which the order parameter smoothly grows as the temperature crosses the critical value. 

Generalizing the definition of entropy in the canonical ensemble to disordered systems, the complexity is usually 
defined as the Legendre Transform of the free energy averaged over quenched disorder:^- 

m) = Pe f - PMPe) (6) 
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FIG. 1: The complexity versus / and u = —m computed at T = 0.5 on the IRSB static solution at fixed m, Eq. (|5J. For p = 3, 
Ts = 0.6513 and Tq = 0.2403. 



with conjugated variables / and f3e = (3 m. The relationship f{m) (or equivalently 'm(f)) is thus obtained, at constant 
temperature, from one of the following formulas: 



/ = 



Pe 



df3e^{f3e) dm $(m) 



d(3e 
df 



dm 



as well as the complexity expression 



S(to) = /3- 



as 

We 



f3m 



2d^{m) 



{(im) 



dr 



-{p- 



l)q^ + log / Vz{2 cosh z%/A)" - m /log 2 cosh z VA 



(7) 
(8) 

(9) 



We notice that the self-consistency equation d^/dm — 0, together with Eq. Q) yields the equilibrium values of m 
and g, corresponding with the lowest free energy feq{T) at which stable states are found at temperature T. Therefore, 
the complexity vanishes at /oq, as lower bound edge. The higher bound edge, /th (or rMth)j is instead the point at 
which its maximum takes place, see figure ^ Probing the free energy landscape in free energy do not yield, however, 
metastable states up to /th, as we are now going to recall (see also Ref. 0). 

The replicon eigenvalue, whose positiveness determines the stability of the phase, ^^ computed with the IRSB Ansatz 
yields 



A=l-fi{p- l)gr' (l - 2gi + (tanh^ zVx) ) = 1 - m(p - l)gr' 



cosh zvA 



>0 



(10) 



The second transition temperature To is then determined as the point at which A = 0. Also, at fixed T g [Tg, Ts], the 
replicon becomes negative above some "Gardner threshold" free energy fa < /th (figure^). Therefore, the complexity 
in this temperature range is well defined only in the interval [fcq, fc]- At T,: fa — /th, at Tq'- /g = /cq- 



III. TAP COMPLEXITY OF THE ISING p-SPIN MODEL 



Another method to derive the complexity, inspired to the Boltzmann microscopical interpretation of the entropy, 
is to directly compute the logarithm of the number of metastable states The further step is now, in comparison 
with ordinary statistical mechanics, that the average over the quenched disorder must also be taken. As a first 
approximation, to be discussed in the following (see also e.g. Refs. |l6ll8l| '). we can consider as state a solution of the 
mean-field equations for the average site magnetizations, else said Thouless- Anderson-Palmer (TAP) equations. 

The computation of the total number of TAP solutions of the Ising p-spin model was performed in Ref. Q ; in this 
section we will generalize it to the case of solutions of a given free energy. We will compute the average number of 
solutions of the following TAP equations: 



tanh^^mi) = 7— Yyy ^ J,j,...jpmj,, . . . , m^^ - m,yp(p - 1)(1 - g)gP"2_ (;l1) 

These equations can be obtained considering the behavior of the cavity field as in Ref. [Tjl but also by differentiation 
of the following free energy functional: 

,,-,,, 1 v-^ / 1 + mi 1 + nii 1 — ?7i,, 1 — 771, \ 



AT ^-^ V 2 2 2 2 

- ^ E Jn.....m,,...m,^-^((p-l)gP-M(^-^^ + l) (12) 

ii<...<ip 

The density of solutions at a given free energy can be expressed as an integral over the whole ?n-space of a delta 
function of the TAP equations: 

M 
P^f) = E / n^"^* ^("^^ - O 5[FTAp{m'^) ~ Nf] = 

= /" n '^^^ '^(a.FTApCm)) I det(a,9,FTAp(m))| 5[FTAp{m) - Nf] , (13) 

where: 5^ stays for the partial derivative with respect to rrii, 

diFTAp{m)) ^ -g{mi) - ——— E •^»j2...jp™j2> • ■ ■ : ^^p (14) 

5(mi) = tanh '^{rrii) + mi— p{p - l){l - q)qP^'^ . (15) 

+ ^p{p-mp-'i)<f-'-{p-i)<f-')^- (16) 

^- = (21! ^ Jijk3...kpmk:,,...,mk^ (17) 

Notice that the last term in equation (|16|l is order 0{1/N), its effect will be discussed below. The delta function over 
the TAP equations S{diF) can be expressed in an integral form while, after dropping the modulus, the determinant of 
the Hessian in Eq. p3|l can be expressed in integral form through a replicated bosonic representatior&i^ or through 
a fermionic representationiiSiiLiSiiSiSfliSi The details of the computation in the case of the Ising p-spin model can be 
found in Ref. jOJ- Here we concentrate only on the last term in Eq. H13(l . i.e. the delta function on the free energy. 
Following the original paper of Bray and Moorei^ we use a non- variational form of the free energy function (|12ll that 
is valid only on the solutions of the TAP equations. This form is obtained substituting equation (|ll|l in equation 112|l . 
We recall that, using this non-variational expression does not break the supersymmetry of the problem, as noted in 
Ref. H. 

As an intermediate step we report the expression of p{f) in terms of a fermionic-bosonic action: 

p{f) = fv^Vi^ Vm Vx e'S({'>'V^'^.™}) (18) 

S{{tp,lp,x,m}) = I3l^(x, + -mij diFrApim) +^iJiipjd,djFTAp{m) + u FxApim) -u N f\ (19) 



satisfying the fermionic symmetry: 



S'ipi — Sip, — —exi Srui — eTpi Sxi — e—ipi 

P 



(20) 



where e is a fermionic small number. This invariance, said Becchi-Rouct-Stora-Tyutin (BRST), can otherwise be 
expressed through Ward identities as: 



{'4'ttpi) = - {m^X^) + - (to- ) 
— U^ 

u (i^i^i) = (xj) - {miXi) + — {ml) 



(21) 
(22) 



where the average is performed over the measure e . 

After some further standard manipulations we obtain the free energy of a TAP solution as a sum of N local terms 
f{mi) where: 



1 p — 1 

/3/(m) = - ln(l - m^) - ln2 + m tanh^Vm) + 

2 p 

- ^[l + (p-2)g^-i-(p-l)gP] 



(23) 



The last expression allows to obtain the generalization of the equations for the computation of the complexity of the 
Ising p-spin model performed by Rieger A The resulting expression is an integral over a finite number of macroscopic 
variables that can be evaluated by the saddle point method. The variational expression of the annealed complexity 
is: 



B^-A^ 



E(/) = — ln/9(/) = Ext-/u/3- (1-g) (B + A)-gA4 



In/ 



where 



/ = 



-1 y/2nnqP-^ \l-m 



B I cxp 



(tanh"^(TO) - Ai 



2^9' 



,p-i 



+ \m'^ + u(3f{m) 



dm 



The saddle point equations obtained extremizing with respect to u,\,/S.,q and B are: 



(24) 



(25) 



/ = (/M) 
q — (to, ) 

A = 



(p- 1) Ai (1 - q) qP^'^ (P- 1) {m tanh"^(TO)) 



P 



pq 



1-q 



i? I A I (2-p)g^-^(^^-A^) p-l / ((TOA-tanh-^TO)) Y 
2{-l+p)fi 2q [ ^lqP-^ 

^{p-2){p- 1) qP-^ + ^P'P^P-^) ,P-1 

// 1 ^ 



^i{p-l) qp-^ 



1 — m^ 



(26) 

(27) 

(28) 



(29) 
(30) 



The brackets (. . .) in the previous equations represent averages with respect to the integrand in Eq. H25f) . 

In order to probe the complexity at different free energy levels, Eq. (|26|l is relaxed and the remaining equations are 
solved at fixed u . Moreover, the request of a positive replicon implies that, in Eq. (|30|) . we choose the solution B = 
(see Ref. |l5ll8( for p = 2 or App. B for any p). 



IV. THE COMPLEXITY OF THE ISING p-SPIN MODEL 

As it was the case in the Sherrington-Kirkpatrick (SK) model, ^^ also for p > 2, two different solutions of the above 
saddle point equations 127|) - (|29|l exist. In one of them the parameters q, A and A satisfy the relations 

A^~^{p-l)uqP-^ (31) 

A = ^fcIl!.V- (32) 

4 p 

deriving from the BRST Ward identities Eqs. (|?T|l - lf^ . In the second solution, instead, Eqs. (J3IJ-(|221) do not hold, 
i.e. the system is not invariant under the transformation Eq. (|20|l . 

We notice that the first solution coincides with the static (IRSB) solution, that is stable in the range of temperature 
T e [TQ{p),Td{p)]. Therefore the complexity coincides with Eq. Q, as it is clear substituting relations l|^ - l|H^ into 
Eqs. H24|l and H25|l. changing the integration variable in Eq. (|25|l as m = tanh(/3z) and eventually setting u = —m. 
(see also thoroughly discussion in, e.g., Refs. [lallq |'). 

Setting p = 3 the first transition temperature is Ts = 0.6513 and the second one turns out to be Tq = 0.24026 
(obtained equating Eqs. H1U|I and lO to zero). In figure|21 for T — 0.5, we plot the overlap q as a function of u for both 
solutions of the saddle point equations (|27|) - (|29|l and for the IRSB solution. We also plot the other two parameters 
A and A as a function of q^^^u and qP~^v? respectively. For the BRST solution they are constant (Eqs. (|31() - (|32(l ). 

In figureiniwe plot 1/A^logp on both saddle points. The behavior in shown both versus / and u. In the / plot the 
BRST complexity (coinciding with Tiihsb) has a cusp. We stress, however, that the upper, concave, branch has to 
be rejected on physical ground because there 

and looking at the complexity as a generalization of standard entropy this corresponds to a thermodynamic instability. 
Indeed, definining the complexity as the Legendre transform of $ allows us to look at Eq. (jHl as the saddle point of 
the integrand of the partition of the states counted with the measure exp{— /3eN f) , i.e. 

J df uj{f) exp{-/3e7V/} ^ Jdf exp{-/3eiV/ + A^S(/)} ^ J dF exp{-/3e$(/)} ~ exp{-/3e$(/^^)} (34) 



and the condition for the integrand to be a maximum is 



W-'W<' (35) 



At a given temperature the so-computed complexities start from different lower band edges of free energy /q. In 
the BRST case /o = /cq. In the other case /o < /cq- They cross at the value of u (or —m in the replica formalism) at 
which the overlap-overlap stability eigenvalue, the replicon of Eq. (|10() becomes negative for the IRSB solution. We 
call this crossing point ug, or /g, the 'Gardner' stability threshold for low energy metastable states. 

In terms of TAP equations the stability criterionS^ analogous to A > is formulated as the Plefka criterionS^ 

Xp = l-^i{p-l)qP-^{{l-m'^)^)>0 (36) 

A sketch of the derivation is reported is App. A. When Xp is computed over the two saddle points one sees that at any 
/ (or u) one, and only one, solution is always stable. The two Xp, indeed, cross when they both reach zero, one from 
above and one from below, at fo- We explicitely show this in figure 0] where we also plot the difference in complexity 
over the two saddle points. For f < fa the BRST complexity is consistent and larger, whereas for f > fa the roles 
are exchanged. 

As the temperature decreases towards Tq the crossing point shifts towards the lower band edge. To exemplify this, 
in figure [S] we have plotted complexities and Plefka parameter/replicon for the p = 3 model both at T — 0.5 and 
T ~ 0.25. Exactly at Tq = 0.2403, /g and /o coincide. At this point the BRST complexity, counting the number 
of minima'^*' of the free energy landscape turns out to be physically inconsistent on all states but those at / = /eq. 
Lowering further the temperature we end up in a FRSB spin glass phase, for which both the IRSB solution and the 
annealed complexity are ill defined. In this region the system behaves exactly as the SK model. This means that, 
even performing the proper FRSB quenched average, the BRST complexity has to be rejected for any value of / 
apart from /cq (computed in the FRSB phase) iS& The only likely candidate as a metastable states counter remains 
the non-BRST complexity. 
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FIG. 2: The self-overlap g on both complexity saddle points. SPl is BRST symmetric, SP2 is not. The cross points represent 
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are shown versus u. When the BRST relations 13111 - 132(1 are satisfied they are constant. 



0.07 




0.06 




0.05 




0.04 




0.03 




0.02 




0.01 







„,:^_ 



T=0.5 
sol 2 - 
sol 1 (IRSB) 





FIG. 3: The complexity computed as the annealed average of the logarithm of the number of TAP solutions. Both the BRST 
and the non-BRST solutions are plotted. The three vertical lines in the left plot stay for, from left to right respectively, the 
BRST lower band edge /oq, the crossing point fa and the value of maximum non-BRST complexity. 



A. Deepening on The Crossing Point 

In appendices A and B we recall that the condition of positivity of xp is recovered also in the present context as 
a condition of physical consistency of the TAP solutions and of analytical consistency of the B = solution. Thus 
the identification of the crossing point with the point where the replicon vanishes is crucial because it ensures that 
at all free energies we can choose a solution with a positive value of the replicon. This identification can be justified 
analytically. The solution at a given value of / can be continued in a unique way if the Hessian of (|24|l with respect 
to B, A, A,g and u has no zero eigenvalue, hence a necessary condition to locate a crossing point is that the Hessian 
must have at least a zero eigenvalue. In the following we will show that the vanishing of the replicon or equivalently 
of the parameter xp is a sufficient condition to have a zero eigenvalue in the Hessian. We start from the following 
important relationshipi^ that can be derived from the saddle point equation: 



5E as 



B 



1 



2\2 



(1-m^) 



(37) 



dB ' dX \^i{p-l)qP-^ 'l + S(l-m2)' 

It is easily seen that deriving the previous equation with respect to the five parameter A, A.,q, u, B and then setting 
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FIG. 4: Model with p = 3. On the left side the complexities are plotted ai T — 0.5 vs. /. The continuous line is for the 
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static IRSB complexity (that superimposes on the BRST complexity). In the same figure the replicon and Xp for both the 
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the BRST/IRSB complexity occurs. 
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FIG. 5: The continuous lines are the complexities and Plefka parameters for BRST and non-BRST solutions at T = 0.5 and 
T = 0.25 (Ts = 0. 6513, Tg — 0.2403). As the temperature decreases /g tends to /cq. The cross points represent the IRSB 
complexity [Eq. @] and the IRSB replicon [Eq. ([TUl l. 



B = we have: 



9^1] 



d^ 

dBdX^'oy 
9^1] a^E 

+ 



dBdA dXdA 



(38) 
(39) 






dBdu dXdu 



(41) 
((l-m^)^)') (42) 



9^2 9A9B \^i{p-l) qp-^ 

Notice that the r.h.s. of the last equation is proportional to the replicon Eq. H36|l . therefore if the replicon vanishes 
the r.h.s. 's of the last five equations are all zero, meaning that two columns of the Hessian of (|24|l sum up to zero and 
therefore it must have at least a zero eigenvalue. 

V. SUPERSYMMETRY AND THE SPECTRUM OF THE HESSIAN 

In this section we will discuss the TAP complexity of the Ising p-spin model within the supersymmetryc (SUSY) 
framework. The main result is that much as in the SK model , the TAP solutions described by the non-SUSY solution 
valid at high free energies display a vanishing isolated eigenvalue in the spectrum of the Hessian. 

This result, originally obtained for the SK model in |2J|, was proven rigorously in |23| where it was shown that it is 
a consequence of SUSY breaking. As such the extension to a SUSY-breaking solution in a different model like the one 
we are considering here is straightforward. The rest of this section is rather technical and the reader not interested 
in the details can safely skip to the conclusion. 

The details of the calculations are similar to those performed for the SK modeliSiiLi2i2L2^ and will not be presented. 
In particular, a self-contained derivation of the final results would be a trivial rewriting of the results of |2j| and |25l |. 
therefore we will simply recall them and discuss the basic steps of their generalization to the Ising p-spin model. 
The starting point is the expression of the determinant in H13|l by means of a fermionic representation. Then the 
complexity is expressed as an integral over an action depending on 4A^ fermionic and bosonic variables . The action 
is invariant under the so called Becchi-Rouet-Stora-Tyutin (BRST) transformationSaS,. This transformation mixes 
bosonic and fermionic variables i. e. it is a SUSY transformation. Then, through odd and even Hubbard-Stratonovich 
transformation the complexity is expressed as an integral over the exponential of a macroscopic action depending on 
four bosonic and four fermionic macroscopic variables {r, t, A, q, /x, /J, p, p}. The macroscopic action posses a SUSY as 
welUi^. Setting the fermionic variables to zero and making proper changes of variables one recovers the expression 
^^ for the Complexity. 

The integral over the action can be evaluated by the saddle point method. As we have shown in the previous 
sections the resulting action admits two solutions, much as the one of the SK model. One of these solutions is SUSY 
while the other is not but at variance with the SK model none of them is good in the whole range of free energies. 
Indeed the SUSY solution is correct at low free energies, particularly at the equilibrium value, while the non-SUSY 
solution is correct at high free energy and in particular must be considered to describe the total complexity. Setting 
B — the SUSY relationships expressed in the variables of H24|l are 

p ' 2p2 

Note that according to these equation the BRST relationships at u = are A = and A = 0, and imply a zero total 
complexity, the non-SUSY solution instead predicts a finite complexity while the parameter A and A satisfies some 
proper SUSY Ward identities'^ different from H43f) . All the properties of the non-SUSY solution derived from SUSY 
violation in the SK model apply as well in the case of the Ising p-spin model. In particular it is straightforwward to 
generalize the arguments of [i3| and |2j| showing that the expansion in power of 1/7V of the prefactor to the exponential 
contribution vanishes at all order at all free energies. In the following we concentrate on the TAP spectrum. The 
computation of the resolvent of the Hessian 11()|) without the last 0(1/A^) term can be made following the same lines 
of I23. 

The discussion greatly simplifies noticing that the term Jij in H16|) is a random term much as J^ in the SK model 
but with a variance dependent on the self-overlap. This effect can be simply accounted for through a rescaling of 
the temperature. Thus we obtain the same picture of the SK model^: the extensive part of the spectrum is always 
positive at any value of the magnetizations and is zero only if the following parameter is zero 

xp = 1 - m(p - l)q'-'j^ E(l - "^')'- (44) 
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The parameter xp controls the value of the susceptibility of the TAP equations, only if xp is greater or equal than 
zero the susceptibility of the TAP solutions has the physical value x = /^(l — 9)) see also discussion in appendix A. In 
this context the condition xp >Q appears only as a condition of physical consistence for the TAP solution, however 
it can be shown that it is also a condition of analytical consistence for the computation of the complexity once the 
solution with B = is adopted in H24I) , see appendix B and the discussion in j ilO, 15 . 18 . 27] . It can be also derived as 
a stability condition in the replica framework''. 

As originally noted in |2J| in the context of the SK model, the last 0{1/N) term in the Hessian Hlt)|) splits the 
lowest eigenvalue outside the continuous band of a finite amount^^'^'*'^- . This property is related to the fact that this 
term is proportional to the projector P^- = mirrij. The effect of the isolated eigenvalue on the determinant of the 
Hessian depends on proper bilinear forms. In particular if the quantity 

^E-^(a^) ™. (45) 

is divergent then the isolated eigenvalue must be zero. In |22 it was shown that this result holds for the BM solution 
in the SK model because of the SUSY violation and the argument can be easily applied in the present context. First 
of all we notice that the effect of a projection term on a matrix does not depends on the model considered, therefore 
we arrive at the same conclusion that if the quantity (|45|) is divergent the isolated eigenvalue is zero. This quantity 
can be expressed as the average of microscopic fermionic variables and then as the average of macroscopic fermionic 
variables: 

1 / d^F \^^ 1 — 

ij ^ '^ U ij 

The final result is obtained noticing that this average is divergent because at the denominator the integral over the 
fermionic variables produces a zero prefactor to the bosonic exponential contribution while at the numerator the 
prefactor is finite because of the presence of the fermionic variables on which the average is performed, see eq. (58-60) 

iniia. 

Finally let us comment on an interesting aspect that is specific of the Ising p-spin model. In [23 it was shown that 
while the relevant TAP solutions have a vanishing isolated eigenvalue nevertheless there is an exponential number of 
couples of TAP solutions with a well defined value of it. These couples of states can be continued upon a variation 
of the external parameters, e.g. the temperature, and as a consequence the complexity is continuous. According to 
the work of Rieger, however, the complexity (non-BRST) of the Ising p-spin model presents a discontinuity at a given 
temperature, Tc{p). This can be accounted if the Hessian of H24|) has a singular behavior at Tc{p) as the figures 1 and 
2 of Ref. la suggest. As a consequence the bell shaped curve E(g) of |25|] collapses to a delta function, meaning that 
Tc{p) is the only temperature where all the TAP solutions have a zero isolated eigenvalue. 

VI. CONCLUSION 

In conclusion, we have investigated the complexity of the TAP solutions of the p-spin model as a function of their 
free energy in the range of temperatures where the static solution is IRSB. At any free energy we have found two 
solutions of the saddle point equations, one is non-BRST, while the other satisfies the BRST symmetry and it is the 
one computed in the IRSB framework inQ- At each free energy we can select the correct solution considering the 
stability of the replicon, indeed where one is solution is stable the other is not. The two solutions coincide at the value 
of the free energy fa where the replicon exaclty vanishes. Above fa the non-BRST solution must be chosen while 
below fa the BRST one holds. This implies that below fa the states computed by the complexity are proper minima, 
with all positive eigenvalues, whereas above it the large majority of 'states' (exponentially large with TV) are stationary 
points of the TAP landscape with a zero eigenvalue in the TAP Hessian, possibly implying a qualitatively different 
dynamic behavior of the system evolving above and below the Gardner threshold. We also recall that in |25i] it was 
shown the in the non-SUSY phase there are also well-defined minima and saddles of order one. The number of these 
TAP solutions with a definitively non-zero isolated eigenvalue is exponential in TV although with a lower complexity 
in comparison with the one of the marginal states. We stress that, unlike in the SK model, in the present case the 
annealed complexity is exact, yielding the right quantitative values at any / and that the stability condition holds 
in the whole dominion. We notice that in a simpler model (without Gardner threshold, nor lower lying FRSB frozen 
phase) i.e. the spherical 3-spin model perturbed by a four spins interaction, quite recently presented in Ref. |28j . a 
similar phenomenon occur. Also there the BRST and the non-BRST complexities cross where the Plefka parameter 
related to each of them vanishes. 
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In Ref. 0, where fa was introduced, it was conjectured that above the Gardner threshold an exponential number of 
states continues to exist, their organization being of the FRSB type. What we have found here is rather a SUSY/non- 
SUSY transition such that, at high free energy ([/g, /th]), the majority of 'states' shares the property of having an 
isolated zero eigenvalue and this feature is connected to the violation of the BRST relations. In the SK model the 
only likely complexity for the whole free energy domain in the whole temperature range below the critical point is 
non-BRST (this is also the case for the Ising p-spin model below Tq). The only difference with the case here presented 
being that the annealed complexity is just an approximation for FRSB systems and, at least for the lowest values of 
/, the complexity must be corrected by means of a quenched computation. Indeed, in agreement with Montanari and 
Ricci-Tersenghii, some kind of states are present even above fc and their number exponentially grows with the size 
of the system. However, according to our results, no actual phase transition to a FRSB phase occurs but a different 
organization of the "valleys" and "passes" of the free energy landscape at high altitude. However the problem of the 
cluster complexity as suggested in Q remains open. The SUSY/non-SUSY transition that we have found here may 
occur also in models defined on locally tree- like lattices like those considered in optimization problems. A theory for 
the computation of the complexity in tree-like models has been recently presented in [2a| through the cavity method; 
in that context the transition corresponds to the development of non-zero z-fields. 
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Appendix A: Stability analysis 

The stability is governed by the Hessian Eq. Hl()|) . i.e. the inverse susceptibility matrix 

'^^ nor. . NN ^1 1 . P 

X ' " 



1 = -^ = d,d,FTAp{m)) = f -gY^^ + 2^^ - 1)(1 - 5)9""' J ^n " 4" (47) 



J^i = / 2)! ^ ^yfe3-fcpmfe3,...,mfep (48) 

"•3 1 ■ ■ ■ '.f^y 

To perform the stability check following the lines of Refs. J23l27l | we notice that 

■^^^ " ((p-2)!)2 I ^ JnH-Kmk^.---,mkA (49) 



((p-2)!)2^-^ '' ^-^ "ijk3...kp fc3'---' fcp ' \]\J2 

ip-2)l 2NP-^^ \N^J 2 N \N^ 



Defining ap = p{p — l)q^ ^/2 and 



ap 

-1 _ ^ij 


= 5,, 1 


( ^ ^ 


■'' ~ ap 


\apl3{l -m^) 



(50) 
+ a.pP{l -q)]~ K,, (51) 



and introducing the resolvent 

i?(z) = ^Tr(z-r') (52) 

satisfying the property '^R{z) > for 3z < 0, the analysis of Refs. |23l27| yields that the physical solution is given 
by 

R{z) = z(l-—\-apl3{l-q) (53) 
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with the condition 

9 N 

^^^l-^E(l-"^')'>0 (54) 

4=1 

This way the local suceptibility takes the right form 

»^^Trx-^Trx=— (-5R(i?(z))) = /3(1 - (?) (55) 

The condition Xp > over the {m} configurations is equivalent to the replicon positivity in the framework of 
replicas. 

Appendix B: Connection between the B — complexity saddle point and the Plefka parameter. 

Performing the computation of the determinat of the Hessian, Eq. 1)16(1 , one obtains 



f ^ i ~ - - ^ / 1 

det Xi/ = / n ^'^^ ^* "^^P S ~ X! "^y ('^i^i + ^i^"-) + Yl [ 'gnrr 

-' i=l [ i<j i=l ^^^ 

Carrying out the average over the effective couplings J^ leads to 

J n '^^^ ^^ ^^p I "^ ( ij ^'''' ) + T. (^(13 



^ ,2 

n2 



- + apil - q) 



(56) 



det X-\, = I \\dn^'trj^e^p{-^{y^ ^,r?, ) + > J 757^^^ + «p/?(l - <l) ] } (57) 

I \t — J. / t — J. 

dw 



exp{N H{w)} (58) 



w^ 1 ^ / 1 \ 

^(^«) = -^ + ]^ E l°g (^^"P + ;3(i „ ^2) + "p/3(l - g) j (59) 

The saddle point of the above integral is determined by the following equations 

dH 1 v-^ ia 



-w 



^it™"P + /3(T^+"p/3(l-9) = 



dw N 

l^.-1 + i.f; '1 ,<o (61) 



i=l 



.„M-4g^f ,,"-";'' . 1.0 ,62, 



Setting reap = iwap + ap(3{l — q) = iwap + gfi^„^i) + Q^p/3(1 — q), Eqs- (|60|I - H61|I read 

TV f-^ 1 + ivap/3{l - m^) J 

TV A.i + ,„c.p/3(l-mf) >" ^^"^^ 

Eq. (|62l) has two solutions: u = and u ~ v* . In the first case the saddle point condition Eq. I|6»j|l becomes the 
Plefka criterion Eq. l|S^ 
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1-1^E(1-™?) =^>0 (64) 



TV 

i=l 
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li V = V* Eq. H63|l reduces to 



,,^^Y ^"^^ .0 (65) 



-^ {1 + ivap{l - m^)y 

Since tti^ < 1, it must be iv G R^ . In order to make a connection with the rephca notation used in Refs. |a|l5J we 
define B — ivap and Eq. (|62|) becomes 



1 



alP'J^ 1-mj alP^ ^ 



N 



£ 1. mi -..?) < if B'-"?)' w 



^ 1 + 5/5(1 -mf) 



i=l 



Quite clearly the Plefka criterion is not satisfied for any B > 0. On the contrary setting B = the solution is 
consistent with a physical solution. 
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